Information processing system, wireless terminal, and information processing method

ABSTRACT

An information processing system including a video device for displaying a video and a wireless terminal for communicating with the video device and communicating with other apparatuses via a network, wherein the video device transmits video information captured by a camera and sound information collected by a microphone when reception from the wireless terminal of information pertaining to a video to be displayed is detected, and outputs the received sound information using a speaker. The wireless terminal transmits information pertaining to the video to be displayed to the video device, the other apparatuses receive the captured video information and collected sound information via the network, and transmit information pertaining to the video to be displayed and information pertaining to the sound to be outputted.

TECHNICAL FIELD

The present invention relates to an information processing system, awireless terminal, and an information processing method.

BACKGROUND ART

As a background technology in the present technical field, in order toprovide “a projector capable of enabling a user to appropriatelyparticipate in or appropriately view a video conference or a remotepresentation performed on a network”, “a projector which is connectedwith one or more projectors via a network and includes an input meansfor receiving an input of a video signal, a determining means fordetermining the presence or absence of the input of the video signal inthe input means, a projecting means for projecting an image on the basisof the video signal, and a mode selecting means for selecting a servermode or a client mode on the basis of a determination result of thedetermining means, wherein, when the client mode is selected, video datato be projected by the projector is received from the projector in theserver mode on the network, and the received video data is output to theprojecting means, and when the server mode is selected, the video datato be projected by the projecting means is transmitted to the projectorin the client mode on the network” is disclosed in Patent Document 1.

CITATION LIST Patent Document

Patent Document 1: JP 2004-239968 A

SUMMARY OF THE INVENTION Technical Problem

By using the technique disclosed in Patent Document 1, it is possible toparticipate in the video conference as appropriate. However, in order toparticipate in the video conference, it is necessary for a device suchas a projector to establish a connection with the video conferenceserver and transmit authentication information, and thus usability isbad. There is a video call or a video conference by a smartphone, andthere is already authentication for this, but cooperation between thesmartphone and the projector is not taken into consideration.

In this regard, it is an object of the present invention to improve theusability of the user.

Solution to Problem

In order to solve the above problem, for example, configurationsdescribed in claims set forth below are employed.

The present application provides a plurality of configurations forsolving the above-mentioned problems, and as an example, provided is aninformation processing system, including a video device that displays avideo and a wireless terminal that performs communication with the videodevice and performs communication with another apparatus via a network,wherein the video device transmits, if reception of information of thevideo to be displayed from the wireless terminal is detected, the videoinformation captured by a camera and sound information collected by amicrophone, and output received sound information through a speaker, thewireless terminal transmits information of the video to be displayed tothe video device, and the other apparatus receives the captured videoinformation and the collected sound information via a network andtransmit video information to be displayed and sound information to beoutput via the network.

Advantageous Effects of the Invention

According to the present invention, it is possible to improve theusability of the user.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of a system configurationaccording to a first embodiment.

FIG. 2 is a diagram illustrating an example of a video conference.

FIG. 3 is a diagram illustrating an example of a configuration of aprojector.

FIG. 4 is a diagram illustrating an example of a configuration of asmartphone.

FIG. 5 is a sequence diagram illustrating an example of a first videoconference start operation according to the first embodiment.

FIG. 6A is a diagram illustrating an example of a first screen displayof a smartphone.

FIG. 6B is a diagram illustrating an example of a second screen displayof a smartphone.

FIG. 6C is a diagram illustrating an example of a third screen displayof a smartphone.

FIG. 7 is a sequence diagram illustrating an example of a second videoconference start operation according to the first embodiment.

FIG. 8 is a diagram illustrating an example of a system configurationaccording to a second embodiment.

FIG. 9 is a sequence diagram illustrating an example of a first videoconference start operation according to the second embodiment.

FIG. 10 is a sequence diagram illustrating an example of a second videoconference start operation according to the second embodiment.

DESCRIPTION OF EMBODIMENTS

Hereinafter, exemplary embodiments of the present invention will bedescribed with reference to the appended drawings. Each of the followingembodiments is applied to a system in which transmission and receptionof a video captured by a camera and a sound collected by a microphoneare performed between terminals at remote sites via a network(hereinafter referred to as a “video conference system”) as an example,but the video conference system is not limited to the followingembodiments. Further, a system is not limited to the video conferencesystem.

First Embodiment

A first embodiment will be described in connection with a configurationin which, when a video conference with a remote site is performed usinga video conference application of a smartphone (a wireless terminal),the smartphone performs the video conference using a video and a soundobtained by a video conference camera, a microphone, and a speaker whichare installed in a projector and suitable for the use by a plurality ofpersons.

FIG. 1 is a diagram illustrating an example of a configuration of avideo conference system according to the present embodiment. The videoconference system of the present embodiment includes, for example, aprojector 100, a smartphone 110, a network 120, and a video conferenceserver 130. The projector 100 is a device for projecting a video so thatthe video can be seen by a plurality of persons, and a video conferencecamera 101, a microphone 102, and a speaker 112 are installed in theprojector 100.

In the example of FIG. 1 , the camera 101, the microphone 102, and thespeaker 112 are installed in the projector 100, but the camera 101, themicrophone 102, and the speaker 112 may be externally attached to theprojector 100 if necessary, and a plurality of cameras 101, a pluralityof microphones 102, or a plurality of speakers 112 may be installed.

The projector 100 and the smartphone 110 communicate with each otherthrough a predetermined inter-apparatus communication unit built in eachof the projector 100 and the smartphone 110. The inter-apparatuscommunication unit may perform communication via a wireless local areanetwork (LAN) such as Wi-Fi (a registered trademark) or may performcommunication via a wired LAN. Further, other wired or wirelesscommunication such as USB, Bluetooth (a registered trademark), IrDA (aregistered trademark), near field communication (NFC) or the like may beused.

Here, Wi-Fi is a wireless LAN standard established by an Institute ofElectrical and Electronic Engineers (IEEE) standard. USB is a standardestablished by USB Implementers Forum (USB-IF). Bluetooth is a standardestablished by a Bluetooth Special Interest Group (Bluetooth SIG).

The network 120 is a network in which communication can be performedbetween apparatuses at remote sites or in a company such as theInternet, an in-house network, or the like. A wireless LAN such asWi-Fi, or a wired LAN may be included as all or part of the network 120.Further, the network 120 may include a mobile communication network usedfor mobile phones or the like.

The video conference server 130 performs management of a connectionbetween terminals and transfer of data such as a video and a soundtransmitted from each terminal in order to make it possible to performtransmission and reception of a video and a sound among a plurality ofterminals participating in the same video conference upon receiving avideo conference start request from a terminal connected to the network120 such as the smartphone 110. Further, the video conference server 130may accumulate video information of a material distributed at the videoconference and distribute the video information to a plurality ofterminals participating in the same video conference. A sound may beincluded in the information of the materials to be distributed.

FIG. 2 is a diagram illustrating an example of a form in which the useruses the video conference system. In the example of FIG. 2 , a form inwhich the projector 100 is placed on a conference table surrounded by aplurality of persons, and the video conference is performed using thevideo conference application of the smartphone 110 is illustrated. Thesmartphone 110 transmits a video and a sound to the projector 100, and acamera video of the other party of the video conference is shown in aprojection video 201 of the projector 100 as the video transmitted tothe projector 100. Further, a sound collected by a microphone of theother party of the video conference is output from the speaker 112 ofthe projector 100 as the sound transmitted to the projector 100.

In the example of FIG. 2 , the camera video of the other party isprojected on the projection video 201, but the present invention is notlimited thereto, and the video of the material accumulated in the videoconference server 130 may be projected or may be switchable by a switch(not illustrated). Further, the projection video 201 may be divided intotwo, and the camera video of the other party and the video o thematerial may be simultaneously projected.

The video captured by the camera 101 installed in the projector 100 andthe sound collected by the microphone 102 are transmitted to thesmartphone 110 and input to the video conference application of thesmartphone 110. The camera 101 may image an imaging range 202 forparticipants in the video conference, or a plurality of imaging ranges202 may be set so that some of a plurality of participants are imaged.

Further, the camera 101 may image an imaging range 203 including theprojection video 201. The video of the material is projected on theprojection video 201, and for example, the participant points to aspecific part of the material and explains it or overwrites a part ofthe material, and thus content to be explained to the other party of thevideo conference is easily conveyed. The imaging range 202 and theimaging range 203 of the camera 101 may be switchable by a switch (notillustrated), the camera 101 may be physically movable, or both theimaging range 202 and the imaging range 203 may be imaged at the sametime.

Further, the camera 101 may image a paper material, a sample item, orthe like placed on the conference table as the imaging range.

FIG. 3 is a diagram illustrating an example of a configuration of aprojector 100. The projector 100 includes, for example, a camera 101, amicrophone 102, a video/sound input unit 103, a control unit 104, amemory 105, a video decoding/output unit 107, a display unit 109, ansound decoding/output unit 111, a speaker 112, a communication unit 113,an antenna unit 114, a manipulation input unit 115, a videoinput/encoding unit 116, an sound input/encoding unit 117, an inputterminal 118, and the like, and the respective units are connected via abus as illustrated in FIG. 3 .

The control unit 104 includes, for example, a processor, and receivesinformation of an input manipulation of the user via the manipulationinput unit 115 and controls the respective units connected to the bus ofthe projector 100 by executing various kinds of programs 106 stored inthe memory 105. For example, the control unit 104 reads a programs amongvarious kinds of programs 106 from the memory 105, and controls thevideo input/encoding unit 116 and the communication unit 113 inaccordance with the read program such that the video input/encoding unit116 receives and encodes the video captured by the camera 101, and theencoded video is transmitted from the communication unit 113.

The control unit 104 is a system-on-a-chip (SoC) and may include acircuit that separates video/sound information input from thevideo/sound input unit 103 into sound information and video informationand outputs the sound information and the video information to the sounddecoding/output unit 111 and the video decoding/output unit 107 inaddition to the processor. Detailed description of the control of eachpart of the projector 100 by the control unit 104 executing variouskinds of programs 106 is omitted, and an operation of the projector 100will be described with reference to FIGS. 5 and 7.

The memory 105 stores various kinds of programs 106 executed by thecontrol unit 104, data which is written and read out by the control unit104, and the like. Setting information of the projector 100, video data,and sound data may be stored in the memory 105. Various kinds ofprograms 106 stored in the memory 105 may be stored in the memory 105 inadvance at a time point at which the projector 100 is shipped, may bestored in a recording medium such as a semiconductor memory, or may bestored in the memory 105 via a medium connecting unit (not illustrated)and installed.

Further, various kinds of programs 106 may be downloaded from anexternal network via the communication unit 113, stored in the memory105, and installed. The operation performed by the control unit 104executing various kinds of programs 106 may be implemented by hardwareas a circuit for performing the same operation.

The communication unit 113 performs communication with the smartphone110 via the antenna unit 114 in accordance with a predetermined standardor protocol. The standard used by the communication unit 113 may be awireless LAN such as Wi-Fi or a wired LAN. Further, other wired orwireless communication such as USB, Bluetooth, IrDA, NFC, or the likemay be used, and direct communication may be performed without goingthrough the network 120. Further, the communication unit 113 may includea plurality of chips supporting communications of different standardsmounted therein or a single chip supporting communications of aplurality of standards mounted therein.

The communication unit 113 outputs the video/sound information receivedby the antenna unit 114 to the video/sound input unit 103, and transmitsthe video/sound information input from the video input/encoding unit 116and the sound input/encoding unit 117 through the antenna unit 114. Thevideo/sound information received by the antenna unit 114 may be outputto the bus.

The video/sound input unit 103 receives the video/sound information tobe projected by the projector 100 from the input terminal 118. This maybe for an original use of projecting the input video of the projector100 other than the use for the video conference or may be used forreceiving a material referred to in the video conference from a personalcomputer or the like. To this end, the video/sound input unit 103 mayoutput the video/sound information to the bus as well as the controlunit 104.

The input terminal 118 is, for example, a composite terminal, an Sterminal, a D terminal, a component terminal, a VGA terminal, a DVIterminal, an HDMI terminal, or the like. In a case in which an inputfrom the input terminal 118 is an analog signal, the video/sound inputunit 103 may convert an analog signal into a digital signal. Further,the video/sound input unit 103 may select the input from the inputterminal 118 and an input from the communication unit 113 or maysynthesize both inputs.

In a case in which the video/sound input unit 103 outputs thevideo/sound information to the bus, the communication unit 113 mayreceive the video/sound information via the bus and transmit thevideo/sound information through the antenna unit 114. At this time, thevideo information or the sound information may be selected, and forexample, the video information of the material may be transferred fromthe video/sound input unit 103 to the communication unit 113, and thesound information of the person participating in the conference may betransferred from the microphone 102 to the communication unit 113 viathe sound input/encoding unit 117.

The video decoding/output unit 107 decodes the video information inputfrom the control unit 104 if necessary and outputs the decoded videoinformation to the display unit 109. For example, since the videoinformation received by the communication unit 113 iscompressed/encoded, the video information received by the communicationunit 113 is decoded and output, and the video information input from theinput terminal 118 may be output without change since the videoinformation input from the input terminal 118 is not compressed/encoded.The control unit 104 may control whether or not to the decoding isperformed. Part of the video information output from the videodecoding/output unit 107 may be video information generated by thecontrol unit 104 executing various kinds of programs 106.

The display unit 109 is constituted by, for example, a liquid crystalpanel, an optical lens, or the like and projects a video onto a screenor the like. A video projection structure may be a digital lightprocessing (DLP: a registered trademark), a laser light source, or thelike or may be another video projection structure. Further, the displayunit 109 may include a liquid crystal panel or the like that does notproject a video.

The sound decoding/output unit 111 decodes the sound information inputfrom the control unit 104 if necessary and outputs the decoded soundinformation to the speaker 112. For example, since the sound informationreceived by the communication unit 113 is compressed/encoded, the soundinformation received by the communication unit 113 may be decoded andoutput, and since the sound information input from the input terminal118 is not compressed/encoded, the sound information input from theinput terminal 118 may be output without change. The control unit 104may control whether or not the decoding is performed. The soundinformation output by the sound decoding/output unit 111 may be outputto an external apparatus (not illustrated) in place of the speaker 112.

The speaker 112 is preferably a speaker which is omnidirectional andgenerates a sound with a sufficient volume for the conference. Themicrophone 102 is preferably a microphone which is omnidirectional andhas sensitivity capable of collecting the sound of the participant onthe conference table. The speaker 112 and the microphone 102 may be onesin which emphasis is placed on a sound frequency band. Further, aplurality of speaker 112 and a plurality of microphones 102 may beinstalled for an omnidirectional property or the like. The soundinput/encoding unit 117 receives the sound information converted into anelectric signal by the microphone 102, encodes the sound information tocompress an information amount, and outputs the encoded soundinformation to the communication unit 113 via the bus.

The camera 101 images the imaging ranges 202 and 203, converts thecaptured video into an electric signal, and inputs the electric signalto the video input/encoding unit 116. A plurality of cameras 101 may beinstalled in accordance with the imaging ranges 202 and 203, or thelike, and a plurality of cameras 101 may be connected to the videoinput/encoding unit 116. Further, the camera 101 may be mounted on theprojector 100 with a physically movable structure.

The video input/encoding unit 116 receives the video informationconverted into an electric signal by the camera 101, encodes the videoinformation to compress an information amount, and outputs the encodedvideo information to the communication unit 113 via the bus. The videoinput/encoding unit 116 may be connected to a plurality of cameras 101,and in a case in which the video information is input from each of aplurality of cameras 101, video input/encoding unit 116 may select oneof the inputs form a plurality of cameras 101 or may synthesize theinputs from a plurality of cameras 101.

The manipulation input unit 115 is an input device that receives aninput manipulation to the projector 100 from the user, and is, forexample, a remote controller, a keyboard, a pointing device such as amouse or a touch panel, or the like.

In the example of FIG. 3 , the structure of the projector 100 has beendescribed, but a display that displays a video instead of projecting thevideo may be used as the display unit 109, and each structure describedabove with reference to FIG. 3 may be installed in a television receiveror a display device. In other words, the projection video 201illustrated in FIG. 2 may be a television receiver, and the projector100 may be included in the television receiver. In the configuration ofthis television receiver, the camera 101 for imaging the imaging range202 may be installed, and the camera 101 for imaging the imaging range203 may not be installed, or a touch panel or the like may be installedin the television receiver instead of the camera 101 for imaging theimaging range 203.

Further, a configuration in which the display unit 109 and the speaker112 are removed from the configuration illustrated in FIG. 3 , andoutput terminals are installed instead of the display unit 109 and thespeaker 112, and it is configured with a set-top box (STB) or a recorderwhich does not directly display the video or output the sound may beprovided. Further, instead of the projector 100, a personal computer, amonitor device, a tablet terminal, or the like including the respectivecomponents illustrated in FIG. 3 may be used.

FIG. 4 is a diagram illustrating an example of the configuration of thesmartphone 110. The smartphone 110 includes, for example, a camera 405,a microphone 406, a control unit 400, a memory 403, a display unit 401,a manipulation input unit 402, a communication unit 407, a communicationantenna unit 408, a mobile communication unit 409, a mobilecommunication antenna unit 410, and the like.

The control unit 400 includes a processor, reads out and executesvarious kinds of programs 412 stored in the memory 403, and controls therespective units of the smartphone 110 via a bus. The control unit 400is an SoC and may include a circuit related to processing of videos andsounds. The display unit 401 may be a liquid crystal panel, an organicEL (Electroluminescence) display, or the like or may be integrated witha touch panel of the manipulation input unit 402. The camera 405 imagesa specific direction of the smartphone 110, the microphone 406 collectsthe sound around the smartphone 110, and a speaker 411 outputs thesound.

The communication unit 407 performs communication with the projector 100via the communication antenna unit 408 in accordance with apredetermined standard or protocol. The communication standard is astandard in which communication with the projector 100 can be performed.In order to perform communication with the network 120 via the mobilecommunication antenna unit 410, a mobile communication base station (notillustrated), or the like, the mobile communication unit 409 may performcommunication conforming to a mobile communication standard such as 3G,4G, or LTE.

Further, in order to perform communication with the network 120 via themobile communication antenna unit 410, an access point (notillustrated), or the like, the mobile communication unit 409 may performcommunication conforming to a wireless LAN standard such as Wi-Fi.Further, the mobile communication unit 409 may perform communicationwith the network 120 via a wired LAN through a terminal (notillustrated) in place of the mobile communication antenna unit 410 andmay include a plurality of chips supporting communications of differentstandards mounted therein or a single chip supporting communications ofa plurality of standards mounted therein.

As various kinds of programs 412 stored in the memory 403, a videoconference application is included. The video conference application maybe a program such as a video call or the like, and may be an applicationprogram of a telephone call using the display unit 401, the camera 405,the microphone 406, and the like. Further, as various kinds programs412, an operating system (OS) or a presentation application may beincluded.

Hereinafter, an operation example in which the video conference isstarted using the smartphone 110, and the camera 101, the microphone102, and the speaker 112 of the projector 100 are used in the videoconference will be described with reference to FIGS. 5 and 6 .

FIG. 5 is a sequence diagram illustrating an example of a videoconference start operation according to the first embodiment. The videoconference start operation is a sequence in which the video conferencevia the video conference server 130 is started using the videoconference application of the smartphone 110, the display unit 109 andthe speaker 112 of the projector 100 are used for the video and thesound received from the video conference server 130, and the camera 101and the microphone 102 of the projector 100 are used for the video andthe sound to be transmitted to the video conference server 130.

FIGS. 6A, 6B, and 6C are diagrams illustrating an example of a screendisplay of the smartphone 110. In the sequence described with referenceto FIG. 5 , the smartphone 110 displays the screen to be described withreference to FIGS. 6A, 6B, and 6C. The camera 405, the microphone 406,and the display unit 401 in FIGS. 6A, 6B, and 6C are similar to thosedescribed above with reference to FIG. 4 , the manipulation input unit402 is integrated with the display unit 401, and a manipulation is inputwhen the display of the display unit 401 is touched.

Step 500: The smartphone 110 displays a plurality of icons on thedisplay unit 401 as illustrated in FIG. 6A, detects that an icon 601 ofthe video conference application is selected (touched) by the user, andactivates the video conference application.

Step 501: The smartphone 110 displays a screen for prompting an input ofa conference ID, an account/password (authentication information), andthe like for a video conference to participate in on the display unit401, receives the conference ID, the account/password, and the likeinput by user, transmits the input conference ID, the account/password,and the like to the video conference server 130, and requests aconnection to the video conference.

Step 502: The video conference server 130 receives the request from thesmartphone 110, and starts a connection process with a terminalparticipating in the same video conference on the basis of the receivedconference ID, the account/password, and the like.

Step 503: The video conference server 130 establishes a connection withthe terminal participating in the same video conference as the videoconference requested by the smartphone 110, and gives a notificationindicating that the connection has been established to the smartphone110.

Step 504: The smartphone 110 starts a video conference process using thecamera 405, the microphone 406, and the speaker 411 of the smartphone110. Step 505: The smartphone 110 transmits the video captured by thecamera 405 and the sound collected by the microphone 406 to the videoconference server 130. Further, the smartphone 110 receives the videoand the sound of another terminal transmitted from the video conferenceserver 130, displays the video on the display unit 401, and outputs thesound through the speaker 411.

Step 506: The video conference server 130 transfers the video and thesound received from the smartphone 110 to the terminal participating inthe same conference. Further, the video conference server 130 transfersthe video and the sound received from the terminal participating in thesame meeting to the smartphone 110.

Step 507: The smartphone 110 displays a video output destination settingmenu 602 on the display unit 401 as illustrated in FIG. 6B, detects thatthe “projector” is selected (touched) by the user, and transmits thedisplay screen to the projector 100 through the communication unit 407.The video output destination setting menu 602 may be displayed if thevideo conference application is activated or may be displayed if aspecific menu of the video conference application is selected.

Step 508: Upon detecting the reception of the display screen from thesmartphone 110 through the communication unit 113, the projector 100starts displaying the received display screen and proceeds to step 509.

Step 509: The projector 100 gives a notification indicating that thecamera 101, the microphone 102, and the speaker 112 of the projector 100are usable to the smartphone 110 through the communication unit 113.

Step 510: Upon receiving the notification from the projector 100, thesmartphone 110 displays a camera/microphone/speaker use confirmationmenu 603 on the display unit 401 as illustrated in FIG. 6C, the processproceeds to step 511 if “Yes” is selected (touched) by the user, and thevideo conference start operation ends if it is detected that “No” isselected (touched).

Step 511: Since “Yes” is selected in the camera/microphone/speaker useconfirmation menu 603, the smartphone 110 gives a notificationindicating the use of the camera 101, the microphone 102, and thespeaker 112 to the projector 100 through the communication unit 407.

Step 512: Upon receiving the notification of step 511 from thesmartphone 110 through the communication unit 113, the projector 100starts imaging and sound collection using the camera 101 and themicrophone 102 of the projector 100.

Step 513: The projector 100 starts transmitting the video captured bythe camera 101 of the projector 100 and the sound collected by themicrophone 102 to the smartphone 110 through the communication unit 113,and starts receiving the sound from the smartphone 110 so that the soundcan be output through the speaker 112.

Step 514: The smartphone 110 starts receiving the video and the soundfrom the projector 100 through the communication unit 407, and startstransmitting the sound to the projector 100.

Step 515: The smartphone 110 switches the video and the sound to betransmitted to the video conference server 130 from the video and thesound obtained by the camera 405 and the microphone 406 of thesmartphone 110 to the video and the sound received from the projector100, and switches the sound received from the video conference server130 from the output of the speaker 411 to the transmission of the soundto the projector 100.

As described above, when the video conference is started using theapplication used in the smartphone 110, and the smartphone 110 outputsthe video to the projector 100, the projector 100 gives a notificationindicating that the camera 101, the microphone 102, and the speaker 112of the projector are usable to the smartphone 110, and thus acooperation can be easily achieved.

Further, since the smartphone 110 uses the video and the sound obtainedby the camera 101 and the microphone 102 of the projector 100 in thevideo conference and uses the speaker 112 for the sound of the videoconference, it is possible to use the camera, the microphone, and thespeaker suitable for the conference using the smartphone 110 which isdaily used by the user and the application thereof, and thus it ispossible to improve the convenience of the user.

Further, since the information of the smartphone 110 can be used as theinformation for participating in the video conference (theauthentication information, the password, or the like), it is easy toinput information, special dedicated information is unnecessary, and itis easy to use a popular participation procedure.

In the example of the sequence illustrated in FIG. 5 , after the videoconference is started in the smartphone 110 (step 504), the video outputto the projector 100 and the use of the camera 101, the microphone 102,and the speaker 112 of the projector 100 are started, but this sequenceis not limited.

For example, as illustrated in FIG. 7 , before the video conference isstarted by the smartphone 110 (step 714), the video may be output fromthe smartphone 110 to the projector 100 (step 701), and at a time pointat which the video conference application is activated (step 705), thecamera 101, the microphone 102, and the speaker 112 of the projector 100may become usable.

Step 701 to step 703 of FIG. 7 correspond to step 507 to step 509 ofFIG. 5 , and the smartphone 110 receives the notification in step 704.Thereafter, if the video conference application of the smartphone 110 isactivated in step 705, the smartphone 110 executes step 706 on the basisof the notification received in step 704 in advance. Step 707 to step710 correspond to step 511 to step 514, and step 711 to step 714correspond to step 501 to step 504.

Step 715 to step 716 correspond to step 505 to step 506, but in step505, the camera 405 or the like of the smartphone 110 is used, whereasin step 710, if step 710 is already executed, the camera 101 or the likeof the projector 100 is used.

Further, when the smartphone 110 is outputting a screen of anapplication in which it is unnecessary to use the camera, themicrophone, and the speaker such as a presentation application to theprojector 100, the camera/microphone/speaker use confirmation menu 603illustrated in FIG. 6C is not displayed, and thecamera/microphone/speaker use confirmation menu 603 is displayed onlywhen an application in which it is necessary to use the camera, themicrophone, and the speaker such as the video conference application isactivated, the menu display is not complicated, and the convenience ofthe user can be improved.

The communication unit 113 of the projector 100 and the communicationunit 407 of the smartphone 110 may enter a communicable state inadvance, for example, by pairing of Bluetooth or an operation equivalentthereto. Further, the video output from the smartphone 110 to theprojector 100 may be a video output by execution of the OS of thesmartphone 110.

In step 701, if the video can be output by the execution of the OS, atype of video is not limited, and it may be the output of the same videoas the video displayed on the display unit 401 of the smartphone 110.Therefore, a mirror image of the display unit 401 of the smartphone 110may be projected by the projector 100.

As the video conference system, the configuration in which participationin the video conference is performed through communication with thevideo conference server 130 has been described, but the presentinvention is not limited to this configuration. For example, the videoconference server 130 may not be provided, and the smartphone 110 mayperform point-to-point (P2P) communication of directly communicatingwith the terminal participating in the video conference via the network120.

Second Embodiment

A second embodiment of the present invention will be described belowwith reference to FIGS. 8 to 10 . In the first embodiment, the projector100 transmits the video and the sound via the smartphone 110, but in thesecond embodiment, the smartphone 110 is used to participate in thevideo conference, and the projector 100 transmits the video and thesound without going through smartphone 110. Detailed description of thesame configuration as in the first embodiment will be omitted, anddifferent configurations will be described in particular.

FIG. 8 is a diagram illustrating an example of a video conference systemaccording to the second embodiment. A difference from the firstembodiment lies in that the projector 100 can communicate directly withthe network 120. Accordingly, the projector 100 transmits the videocollected by the camera 101 and the sound collected by the microphone102 to the video conference server 130 via the network 120.

The configuration of the projector 100 is similar to that describedabove with reference to FIG. 3 , but the communication unit 113 of theprojector 100 may perform communication with the network 120 via anaccess point or the like in addition to communication with thecommunication unit 407 of the smartphone 110. Further, the projector 100may include a mobile communication unit or a wired communication unit(not illustrated) and performs communication with the network 120. Theconfiguration of the smartphone 110 is similar to that described abovewith reference to FIG. 4 .

FIG. 9 is a sequence diagram illustrating an example of the videoconference start operation according to the second embodiment. Step 900to step 910 of FIG. 9 correspond to step 500 to step 510 of FIG. 5 . Adifference from the sequence diagram of FIG. 5 , that is, step 911 andsubsequent steps will be described below.

Step 911: Since “Yes” is selected in the camera/microphone useconfirmation menu, the smartphone 110 stops transmitting the video andthe sound using the camera 405 and the microphone 406 of the smartphone110 which are being transmitted to the video conference server 130.Further, with the stop, transferring the video and the sound whichreceived from the smartphone 110 to other terminals in the videoconference server 130 is stopped.

Step 912: The smartphone 110 transmits the connection destination of thevideo conference server 130 and information necessary to a connection tothe video conference such as the conference ID and the account/password(the authentication information) to the projector 100, and instructs thevideo conference server 130 to transmit the video and the sound.Further, the connection destination of the video conference server 130may be information indicated by an IP address, a URL, or the like.

Step 913: The projector 100 receives the connection destination of thevideo conference server 130 and the information necessary for aconnection to the video conference such as the conference ID and theaccount/password, and starts imaging and sound collection using thecamera 101 and the microphone 102 of the projector 100.

Step 914: The projector 100 establishes a connection with the videoconference server 130 using the connection destination of the videoconference server 130 and the information necessary for a connection tothe video conference such as the conference ID and the account/passwordreceived from the smartphone 110, and starts transmitting the videocaptured by the camera 101 of the projector 100 and the sound collectedby the microphone 102.

Step 915: The video conference server 130 resumes the transfer of thevideo and the sound to other terminals participating in the same meetingusing the video and the sound received from the projector 100.

As described above, when the video conference is started using theapplication used in the smartphone 110, and the smartphone 110 outputsthe video to the projector 100, the projector 100 gives a notificationindicating that the camera 101, the microphone 102, and the speaker 112of the projector 100 are usable to the smartphone 110, and thus acooperation can be easily achieved.

The smartphone 110 instructs the projector 100 to transmit the video andthe sound obtained by the camera 101 and the microphone 102 of theprojector 100 to the video conference server 130, and thus it ispossible to use the camera 101 and the microphone 102 suitable for theconference using the smartphone 110 which is daily used by the user andthe application thereof, and thus it is possible to improve theconvenience of the user.

Further, since the video and the sound in the video conference aretransmitted directly from the projector 100 to the video conferenceserver 130, for example, it is possible to reduce the amount ofcommunication data of the smartphone 110 via the mobile communicationnetwork and improve the convenience of the user.

In the example of the sequence illustrated in FIG. 9 , after the videoconference is started in the smartphone 110 (step 904), the video outputto the projector 100 and the use of the camera 101, the microphone 102,and the speaker 112 of the projector 100 are started, but this sequenceis not limited.

For example, as illustrated in FIG. 7 , before the video conference isstarted by the smartphone 110 (step 1009), the video may be output fromthe smartphone 110 to the projector 100 (step 1001), and at a time pointat which the video conference application is activated (step 1005), thecamera 101, the microphone 102, and the speaker 112 of the projector 100may become usable.

Step 1001 to step 1003 of FIG. 10 correspond to step 909 to step 909 ofFIG. 9 , and the smartphone 110 receives the notification in step 1004.Thereafter, in step 1005, the video conference application of thesmartphone 110 is activated. Step 1006 to step 1009 correspond to step901 to step 904, and the smartphone 110 executes step 1010 on the basisof the notification received in step 1004 in advance.

Step 1011 to step 1014 correspond to step 912 to step 915. Step 1015corresponds to step 905, and the smartphone 110 uses the camera 405 andthe microphone 406 of the smartphone 110.

Further, when the smartphone 110 is outputting a screen of anapplication in which it is unnecessary to use the camera and themicrophone such as a presentation application to the projector 100, thecamera/microphone use confirmation menu illustrated in FIG. 6C is notdisplayed, and the camera/microphone use confirmation menu is displayedonly when an application in which it is necessary to use the camera andthe microphone such as the video conference application is activated,the menu display is not complicated, and the convenience of the user canbe improved.

A part of the configuration of each embodiment described above may bedeleted or replaced with a part of the configuration of anotherembodiment, and a part of the configuration of another embodiment isadded to the configuration of each embodiment.

REFERENCE SIGNS LIST

-   100 projector-   101 camera-   102 microphone-   110 smartphone-   112 speaker-   120 network-   130 video conference server-   405 camera-   406 microphone-   411 speaker

1. An information processing system, comprising: a video apparatusconfigured to display a video; and a wireless terminal configured toperform communication with the video apparatus and performscommunication with another apparatus via a network, wherein the wirelessterminal is further configured to: i) receive information of a video tobe displayed by the video apparatus from the other apparatus via thenetwork; and ii) transmit the information of the video to be displayedby the video apparatus to the video apparatus, wherein, after receptionof information of the video to be displayed from the wireless terminalis detected, the video apparatus is further configured to: i) transmitinformation of a video captured by a camera of the video apparatus tothe wireless terminal; ii) receive information of a sound from thewireless terminal; and iii) output the received information of the soundby a speaker of the video apparatus, wherein the wireless terminal isfurther configured to: i) receive information of a video to be displayedby the video apparatus from the other apparatus; and ii) transmit theinformation of the video to be displayed by the video apparatus to thevideo apparatus, wherein the wireless terminal is further configured to:i) receive the information of the video captured by the camera of thevideo apparatus from the video apparatus; and ii) transmit the receivedinformation of the video to the other apparatus via the network, andwherein the other apparatus transmits the information of the video to bedisplayed by the video apparatus and the information of the sound to beoutput by the speaker of the video apparatus via the network to thevideo apparatus.